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Abstract 


A  framework  for  studying  asymptotic  orders  of  reachability  in  perturbed 
linear,  time-invariant  systems  is  developed.  The  systems  of  interest  are 
defined  by  matrices  that  have  asymptotic  expansions  in  powers  of  a  perturbation 
parameter  e  about  the  point  0.  The  reachability  structure  is  exposed  via  the 
Smith  form  of  the  reachability  matrix.  This  approach  is  used  to  provide  insight 
into  the  kinds  of  inputs  needed  to  reach  weakly  reachable  target  states,  into 
the  structure  of  high-gain  feedback  for  pole  placement,  and  into  the  types  of 
inputs  that  steer  trajectories  arbitrarily  close  to  almost  (A.BJ-invariant 
subspaces  and  almost  (A.B)-controllability  subspaces. 
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I.  INTRODUCTION 


1.1  MOTIVATION 


In  this  paper,  we  develop  and  apply  a  theory  of  asymptotic  orders  of 
reachability  in  linear  time- invariant  systems  parametrized  by  some  small 
variable,  e.  The  approach  draws  in  part  on  the  algebraic  formulation  of  [1.2]. 
To  provide  a  motivation  for  the  key  issues  in  our  approach,  consider  the 
following  discrete  time  system  as  an  example: 

Example  1.1 

x[k+l]  =  [  oj  j]x[k]  +  [.oi]uCk] 

This  system  is  reachable  but  the  reachability  matrix 

Mai.]  =  [  *;“] 

is  not  very  far  from  a  singular  matrix,  in  that  its  condition  number  is 
4 

approximately  10  .  This  leads  to  numerical  difficulties  in  determining 

reachability,  as  shown  in  [3].  Also,  consider  the  minimum  energy  control 

problem  for  this  system.  The  minimum  energy  control  to  reach  x[2]  =  [1  0]’ 

(where  '  denotes  the  transpose)  from  x[0]  =  0  is  Uj[l]  =  -.5  and  u^[2]  =  1.5, 

while  the  minimum  energy  control  for  x[2]  =  [1  1]’  is  ^[l]  =  49.7  and  ^[2]  = 

—49.  This  order  of  magnitude  difference  between  u^  and  Ug  is  another  indication 

of  near  unreachability.  Still  further  indications  may  be  obtained,  for  example 

by  considering  how  small  a  perturbation  of  the  system  matrices  suffices  to 

destroy  reachability  (in  this  case,  of  the  order  of  0.01),  or  by  examining  the 

magnitude  of  feedback  gain  required  to  shift  poles  by  various  amounts  (in  this 

case,  to  move  the  eigenvalues  by  2,  feedback  gains  of  magnitude  approximately 
2 

10  are  required,  as  illustrated  in  Example  3.1). 
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Our  treatment  of  problems  of  this  type  is  qualitative  rather  than  numerical 
in  nature:  we  assume  that  small  values  in  the  system  are  modeled  by  functions  of 
a  small  parameter  e,  which  implicitly  indicates  the  presence  of  different  orders 
of  coupling  among  state  variables  and  inputs.  The  formulation  that  we  use 
permits  the  state  space  to  be  decomposed  according  to  the  ’’asymptotic  orders  of 
reachability"  of  different  target  states.  Specifically,  we  consider  continuous 
time  and  discrete  time  systems  of  the  form 

x(t)  =  A(e)x(t)  +  B(e)u(t)  (1.1) 

x[k+l]  =  A(e)x[k]  +  B(e)u[k]  (1-2) 

Here  A(e)  and  B(e.)  in  general  have  entries  from  the  field  L(e)  of  functions  £(e) 
that  have  asymptotic  expansions  (see  [4])  of  the  form: 

09 

£(e)  =  2  e.e1  (e-O)  (1.3) 

-k  1 

for  some  finite  k,  so, 

A(e)  :  Ln(e)  ->Ln(e),  B(e)  :  Lm(e)  ->  Ln(e)  (1.4) 

(Strictly  speaking,  we  should  write  ~  instead  of  =  in  (1.3)  to  emphasize  that 
the  series  on  the  right  is  asymptotic  and  not  necessarily  convergent  [4],  but 
this  abuse  of  notation  is  common. ) 

Defining  these  systems  over  L(e)  permits  us  to  examine  the  effect  or 
necessity  of  high  gain  feedback.  However,  many  of  our  results  will  involve 
matrices  over  the  ring  T(e.)  of  functions  t(e)  that  have  asymptotic  expansions  of 
the  form: 

00 

t(t)  =  2  t.e1  (e-O)  (1.5) 

0  1 

For  verification  that  T(e)  is  a  ring,  see  [4.  p.  15].  The  ring  T(e)  is  easily 
shown  to  be  a  principal  ideal  domain  and  L(e)  is  its  field  of  fractions.  This 
allows  us  to  use  various  results  on  matrix  canonical  forms  such  as  the  Smith 
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Form  [5,  App.  B.2]  in  our  development.  (The  symbols  L(e)  and  T(e)  have  been 
chosen  to  serve  as  mnemonics  for  "Laurent-series  like"  and  "Taylor-series 
like”.) 

The  above  formulation  strongly  suggests  connections  with  work  on 
parametrized  linear  systems  [6,7],  and  more  generally  with  studies  of  systems 
over  rings  [8,9].  The  approach  in  this  paper  owes  something  to  our  earlier  work 
[1,2]  on  an  algebraic  framework  for  multiple  time  scale  decomposition  in 
singularly  perturbed  systems,  and  therefore  takes  a  relatively  independent  tack. 
The  important  task  of  making  and  exploiting  explicit  connections  with  the 
literature  on  systems  over  rings  is  left  to  future  work.  (Sontag  [10]  has  shown 
us  that  explicit  connections  are  not  only  possible  but  may  be  quite  fruitful.) 

This  work  was  particularly  motivated  by  the  numerical  problems  encountered 

in  various  pole  placement  methods  and  in  evaluating  system  reachability.  Pole 

placement  and  related  numerical  issues  are  addressed  using  various  approaches  in 

the  current  literature  [11-14].  In  multi-input  systems,  unlike  single-input 

systems,  the  feedback  matrix  that  produces  a  given  set  of  poles  is  not  unique, 

and  the  additional  degrees  of  freedom  may  be  used  to  attain  other  control 

objectives  (see  [14]).  One  may,  for  example,  attempt  to  minimize  the  maximum 

* 

feedback  gain;  [12]  addresses  this  problem  via  numerical  examples  involving 
balancing  [15]  the  A  and  B  matrices  and  redistribution  of  the  feedback  task 
among  the  inputs.  These  examples  contain  some  intuitive  ideas,  but  have  not  led 
to  systematic  procedures  that  work  well  for  well-defined  and  substantial 
classes  of  systems.  One  of  our  objectives  here  is  to  suggest  an  analytical 
approach  to  understanding  and  structuring  feedback  gains  for  pole  placement. 

Another  area  of  numerical  work  involves  criteria  to  measure 
controllability.  Boley  and  Lu  [16]  use  the  "distance  to  the  nearest 
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uncontrollable  system"  as  a  criterion.  They  define  this  by  the  minimum  norm 
perturbation  that  would  make  a  system  uncontrollable.  They  also  relate  this 
concept  to  state  feedback  by  measuring  the  amount  that  the  eigenvalues  move  due 
to  state  feedback  of  bounded  magnitude.  Connections  may  also  be  made  to  the 
literature  on  balanced  realizations.  [15],  where  the  singular  values  of  the 
controllability  Grammian  are  used  to  indicate  nearness  to  uncontrollability. 

The  issue  of  controllability  in  perturbed  systems  of  the  form  (1.1)  has 
been  examined  by  Chow  [17].  He  defines  a  system  to  be  strongly  controllable  if 
the  system  is  controllable  at  e  =  0.  Otherwise,  he  calls  it  weakly  controllable 
and  concludes  that  pole  placement  of  such  systems  will  require  controls  with 
large  gains.  Chow  looks  at  systems  with  two  time  scales  (slow  and  fast),  and  he 
proves  that  a  necessary  and  sufficient  condition  for  such  a  singularly  perturbed 
system  to  be  strongly  controllable  is  the  controllability  of  its  slow  and  fast 
subsystems. 

Our  analysis  goes  further  than  Chow’s  in  that  we  examine  the  relative 

orders  of  reachability  of  different  parts  of  the  state  space.  As  already 

mentioned,  the  methods  we  use  have  some  similarity  to  those  used  by  Lou  et  al. 

* 

[1,2],  who  relate  the  multiple  time  scale  structure  of  the  system  (1.1)  to  the 
invariant  factors  of  A(e),  when  this  matrix  has  entries  from  the  ring  of 
functions  analytic  at  e  =  0.  The  results  in  [1.2]  actually  hold  for  A(e) 
defined  over  the  considerably  more  general  ring  T(e)  used  in  this  paper,  though 
this  fact  was  not  recognized  there.  The  Smith  decomposition  of  A(e)  plays  a  key 
role  in  the  analysis  of  [1,2],  while  the  Smith  decomposition  of  the  reachability 
matrix  is  central  to  the  development  in  this  paper.  While  the  primary  focus  of 
the  work  in  [1,2]  is  on  time  scale  structure,  some  attention  is  paid  there  to 
control.  In  particular.  [1]  gives  results  on  the  use  of  feedback  in  (1.1)  to 
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change  the  time  scale  structure  of  the  system.  The  work  in  [18]  may  be  seen  as 
a  continuation  of  the  work  in  [1.2]  in  that  it  analyzes  the  effect  of  control 
and  feedback  on  the  system  of  (1.1).  This  paper  is  based  on  the  work  in  [18]. 


1.2  OUTLINE 


Throughout  the  paper,  -ye)  will  denote  the  k-step  reachability  matrix: 

-ye)  =  [B(e)  |  A(e)B(e)  |  ...  Ak_1(e)B(e)]  (1.6) 

where  A(e).  B(e)  are  as  in  (1 . 1)— (1.5) .  We  shall  simply  write  <6(e)  for  -ye), 
and  call  this  the  reachability  matrix.  We  also  assume  throughout  that 
(A(e),B(e))  is  reachable  for  all  e  €  (O.a),  a€R+,  or  equivalently  *€(e)  is  full 
row  rank  for  all  e  €  (O.a).  a€]R+. 

In  Section  II,  we  develop  a  theory  of  orders  of  reachability.  We  start 
with  discrete  time  systems  and  illustrate  that  the  orders  of  reachability  can  be 
recovered  from  the  Smith  decomposition  of  the  reachability  matrix.  We  define  a 
standard  form  which  displays  these  orders  explicitly.  Also,  we  show  that 
equivalent  results  hold  for  continuous  time  systems.  In  Section  III,  this 
theory  is  extended  to  pole  placement  by  full  state  feedback  for  systems  with 
entries  over  T(e).  We  also  provide  a  computationally  and  numerically  reasonable 
algorithm  for  pole  placement.  Section  TV  develops  connections  with  Willems’ 
work  on  "almost  invariance”  [19,20].  We  show  how  to  find  an  input  that  steers 
the  trajectories  of  a  system  arbitrarily  close  to  an  almost  (A.B)-invariant 
subspace  and  show  that  the  subspace  that  a  sequence  of  ( A, B)-contro liability 
subspaces  converges  to  is  almost  (A.B)-invarlant.  In  Section  V,  we  summarize 
our  results  and  suggest  problems  for  further  research. 
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II.  ORDERS  OF  REACHABILITY 


II.  1  ^-REACHABILITY  FOR  DISCRETE  TIME  SYSTEMS 

We  start  by  developing  our  theory  of  asymptotic  orders  of  reachability  for 
systems  of  the  form  (1.2)  in  an  analogous  way  to  existing  linear  control  theory. 
In  order  to  provide  a  motivation  for  our  approach,  let  us  start  with  the 
following  counterpart  of  Example  1.1: 

i 

Example  2. 1 : 

x[k+i]  =  [‘  a]*™  +  [i]“M 

SO 

^  -  [l  '2] 

This  system  is  reachable  for  all  e  €  (0,2).  The  minimum  energy  control  sequence 
needed  to  go  from  the  origin  to  Xj[2]  =  [1  0]*  is  u^[l]  =  -l/(2-e)  and  u^[2]  = 
3/(2-e),  which  are  0(1),  [4].  The  minimum  energy  control  sequence  for  ^[2]  = 

[1  1]’  is  =  (~fe+ l)/fe(2-e)  and  Ug^]  =  (2e-l)/e(2-e) ,  which  are  0(l/e). 

This  characterization  of  target  states  by  the  order  of  control  sufficient 
to  reach  them  is  now  generalized  as  follows  for  the  discrete  time  system  (1.2): 

Definition  2.2:  x(e)  €  T^e)  is  -reachable  if  there  exists  an  0(l/e^)  input 
sequence  4f(e)  s  [u’[n-l]  u’[0]]’  such  that  x(e)  is  reached  from  zero  in  n 

steps  using  V(e)  (i.e.  x(e)  =  *€(e)4f(e)). 

Let  3?  be  the  set  of  all  e^-reachable  states,  then  3£°  C  5C1  C  I2  C  . . .  and  3?  is 
a  T(e)-submodule  of  T^e).  We  term  the  e^-reachable  submodule. 


6 


Note  that  if  x(e)  is  e^-reachable,  then  (l/e)x(e)  is  not  necessarily 
^-reachable.  Thus  if  we  had  considered  target  states  in  Ln(e)  in  Definition 
2.2,  then  the  set  of  e^-reachable  states  would  not  be  L(e) -subspaces. 

In  Example  2.1.  St°  =  Im[l  0]  *  +  fcT^e).  X1  =  X2  =  . . .  =  T2^). 

An  interesting  property  of  the  set  of  e^-reachable  submodules  is  that  all 
the  structure  is  embedded  in  the  e^-reachable  submodule.  First  of  all,  note 
that  X?  is  the  restriction  to  T^e)  of  the  image  of  the  reachability  matrix 
under  the  set  of  all  control  sequence  vectors  ^(e)  in  1mn(e).  Also,  the 
e^-reachable  submodule  is  simply  obtained  by  scaling  the  ^-reachable 
submodule  by  1/e.  To  state  this  formally: 

Proposition  2.3:  a0  =  {'e(e)T,nn(fe)}fTrn(fc)  and  FI  eT^e)}  = 

1  fl  eiTn(e)},  for  nonnegative  integers  i,  j  and  j£i. 
e 

Proof:  By  Definition  2.2,  X°  =  {^(eJT^CeJKTT11^) ,  or  in  general 
£J  =  {^(eJl/eV^eJHTr11^).  Then. 

l^^j-if^i^^)}  =  i— {{— l-—ig(e)T,nn(fe)}nfciTI1(e)} 

e  e  eJ 

=  {-4<e(e)'ijnri(£}}rrrn(e)  =  aj 

The  structure  of  the  e^-reachable  submodules  is  not  always  as  easily 
obtained  by  inspection  of  the  pair  (A(e).B(fc))  as  it  was  in  Example  2.1.  To 
illustrate  this,  consider  an  e  perturbation  of  Example  2.1: 

Example  2.4: 

x[k+l]  =  *]x[k]  +  |«M 


for  which 


This  system  is  reachable  for  all  e  €  (0.®).  In  this  case,  we  find  that  x^[2]  = 

o 

[1  0]’  is  fc-reachable,  and  =  [1  1]'  is  a  -reachable.  Therefore,  even  an  e 

perturbation  may  cause  drastic  changes  in  our  submodules.  •* 


II. 2  SMITH  DECOMPOSITION  OF  <€(e) 


The  key  element  in  our  results  is  the  Smith  decomposition  of  H»(e).  since  in 
effect  this  tells  us  how  <€(fc)  becomes  singular  as  eiO.  The  nxmn  matrix  *€(£), 
which  has  been  assumed  to  have  full  row  rank  for  e€(0,a),  has  a  Smith 
decomposition  [1,  2,  5,  21.  22] 

<€(e)  =  P(e)D(e)Q(e)  (2.1) 

where  P(e),  nxn,  is  unimodular  (detP(O)^O),  Q(e),  nxmn.  is  full  row  rank  at  e=0, 

hence,  right-invertible  over  T(e);  and 

D(e)  =  diag{e~hI  ,  e_h+1I  . I  . ftkI_  }  (2.2) 

p-h  p-h+l  p0  He 

is  nxn  where  1^  denotes  a  p^xp^  identity  matrix  with  p^=0  corresponding  to 

absence  of  the  i-th  block,  and  with  p^^O.  We  shall  term  k  the  order  of 
reachabl i ty  of  the  system,  for  reasons  that  will  become  clear.  The  indices  pi , 
and  hence  D(e),  are  unique,  though  P(e)  and  Q(e)  are  not. 

For  the  remainder  of  this  section,  we  will  assume,  without  loss  of 
generality,  that  h=0  as  this  can  simply  be  achieved  by  scaling  the  input  by 
Now,  from  Proposition  2.3  and  Equation  (2.1),  =  Pfe)^  where 

+  e«j+1  +  ...  +  tk"1'j«k_1  +  fek"JTn(e)  (2.3) 

and  =  Im[In  0]’,  n^  =  p^+  ...  +Pj.  In  fact  1/^  is  just  the  e^-reachable 

submodule  of  the  new  description  obtained  through  similarity  transformation  by 
P(e),  and  its  structure  immediately  follows  from  the  fact  that  the  reachability 
matrix  of  the  transformed  system  is  D(e)Q(e)  with  Q(e)  right  invertible  over 
T(fe).  This  transformed  system  is  examined  further  in  the  next  subsection. 
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II. 3  STANDARD  FORM 


Consider  a  pair  (A(e).B(e))  with  a  Smith  decomposition  of  its  reachability 

lc 

matrix  defined  as  above.  We  will  term  such  a  system  an  a  -reachable  system  with 

(reachability  order)  indices  nQ . i^.  Let  A(t)  =  P-1 (e)A(e)P(e)  and  B(e)  = 

P  ^(fc)B(e).  The  pair  (A(e).B(e))  will  be  called  a  s tandard  form  for 
(A(e).B(e)). 

The  system  in  Example  2.1  is  already  in  standard  form,  because  it  has  a 
Smith  decomposition  with  P(e)=I.  For  the  system  in  Example  2.4,  a  Smith 
decomposition  of  the  reachability  matrix  is: 

t  ?]  [o  l*]  [o  -1£]  -  P(OD(d)Q(e) 

2 

The  structure  of  D(e)  uncovers  the  previously  hidden  a  structure.  To  see  this 
more  explicitly,  transform  the  system  by  P(e,): 
y|>i]  -  [ill  2le]y[k]  +  [J]u[k] 

A  standard  form  for  a  system  is  termed  a  proper  s tandard  form  if  A(e)  has 
the  following  structure: 

A0,0^e^  1/eA0,l^  •  *  •  A0.k^e^ 

=  eAx  Q(e)  Aiti(fe)  ■  ■  1/6  Al,k^6^ 

fckAk.0(fe)  fek"lAk.l(fe)  •  •  : 

i 

where  the  Aj  ^(e)  are  over  T(e),  and  nj  =  ^  p^.  Note  that  in  this  case,  due 

j=0 

to  the  structure  of  A(e)  and  <e(e).  satisfying  our  assumption  that  h=0  in  (2.2) 
only  requires  scaling  B(e)  or  equivalently  B(e)  such  that  its  leading  order  term 
is  a®.  Then,  B(e)  has  the  structure: 


>p0 

}pl 

(2.4a) 
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B(e)  = 


>P0 

>P1 


(2.4b) 


B0(fe) 

eBjffc) 


Example  2.1  and  the  transformed  version  of  Example  2.4  are  both  in  proper 
standard  form.  In  fact,  the  next  result  shows  that  finding  one  proper  standard 
form  is  enough  to  conclude  that  all  standard  forms  of  a  pair  are  proper: 


Proposition  2.5:  If  a  pair  (A(fc).B(e))  has  a  proper  standard  form,  then  all 
standard  forms  of  (A(e).B(e))  are  proper. 

Proof:  Let  <€(e)  =  P^eJDOOQj  (e)  =  P2(e)D{fc)Q2(e) .  then  A^e)  =  ?~i1(e)A(e)?i(e) . 

B^e)  =  P^^(e)B(e)  for  1=1,2  are  two  standard  forms.  Suppose  that  the  pair 

—  —  ~  —1  — 

(A^fe)  .Bjfe))  is  a  proper  standard  form.  Let  Aj(e)  =  D  (e)Ai(e)D(e) . 

^  .1  „  /v 

B^(e)  =  D  (e)B^(e)  for  i=l,2.  Note  A^(e)  and  B^(e)  are  both  over  T(e).  We 

'V 

wish  to  show  that  the  same  is  true  for  A^e)  and  B2(e).  Let 

R(e)  =  D  1(e)P21(e)P1(e)D(fe) .  then  R(e)  is  invertible  over  L(e),  and 

QgCe)  =  R(e)Q1(e).  But  then  R(e)  =  QgCOQjffc)  and  R  *(&)  =  Q^eJQ^e),  where 

Q^(e)  denotes  the  right  inverse  of  Qj(e).  which  exists  over  T(e).  Thus.  R(e)  is 

«  'V  <V  «V  4 

unimodular.  Since  (Aj(e) .B^(e))  is  over  T(e)  and  A^e)  =  R(e)A^(e)R  (e), 

~  ~  »y 

B2(e)  =  R(e)Bj(e),  the  pair  (A^e) ,B2(e))  is  also  over  T(e).  Therefore. 

(A^e)  ,§2(e))  is  a  proper  standard  form. 

A  pair  (A(e).B(e))  is  termed  proper  if  it  has  a  proper  standard  form. 

Thus,  the  systems  in  both  Examples  2.1  and  2.4  are  proper.  It  turns  out  that 
the  condition  that  the  coefficients  of  the  characteristic  polynomial  of  A(e)  are 
over  T(e)  is  necessary  and  sufficient  for  a  system  to  be  proper.  In  general,  we 
have  the  following: 
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Proposition  2.6:  The  following  statements  are  equivalent: 


1.  (A(fc).B(e))  is  proper. 

2.  <ei(fc)=[B(e) |  ...  Ai-1(e)B(e)]  for  all  positive  integers  i  is  over  T(e).  To 
say  this  more  simply,  ^(e)  is  over  T(e). 

3.  The  coefficients  of  the  characteristic  polynomial,  o(A(e)),  of  A(e)  are  over 
T(e). 

Proof  (l-»2)  Follows  from  the  definition  of  a  proper  form  and  the  structure  in 
(2.4). 

(2-*3)  It  is  not  hard  to  show,  using  Theorem  1.15  of  [8],  that  T(e)  is  completely 

i— 1  oo 

integral lv  closed.  Since  ^(e)  is  over  T(e),  the  map  (A  (e)B(fc)}^_^  is  over 
T(e).  Finally,  by  invoking  Theorem  4.17  of  [8],  we  achieve  the  desired  result. 
An  alternative  proof  may  be  obtained  by  working  with  the  Jordan  form  of  A(e), 
and  using  results  in  [23]. 

(3-»l)  Let  A(e)  =  D_1 (e)A(e)D(e) .  i(e)  =  D_1(fc)B(e).  Since  is  over 

a/  ^ 

T(e),  B(e)  is  also  over  T(e).  Since  the  coefficients  of  a(A(e))  are  over  T(e), 

<v 

it  follows  from  the  Cayley-Hamilton  theorem  that  ^(e.)  is  over  T(e).  In 

<V  /V 

particular,  A(e)<6n(fe)  is  over  T(e)  and  since  Q(e)  is  right  invertible  over  T(e), 
A(e)  is  over  T(e).  Therefore,  (A(e),  B(e))  is  a  proper  standard  form. 

As  an  immediate  consequence  of  Statement  2  of  Proposition  2.6  we  have  the 
following  important  property  of  proper  systems: 

Corollary  2.7:  Given  a  proper  pair  (A(e).B(e)).  x  €  iff  x  is  reachable  with 
0(l/e^)  control  in  p  steps,  for  all  pj>n. 

For  proper  systems,  therefore,  it  suffices  to  work  with  the  Smith  structure  of 
<en(e)  =  <e(e). 


Let  us  also  supplement  Proposition  2.6  with  the  following: 
Corollary  2.8:  H?w(e)  is  over  T(e)  iff  <6  ^(e}  is  over  T(e). 
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Proof :  (-»)  Since  ^n+j(fe)  -  [B(e)  I  ^(fe)<®n(fe)]>  *fin(fe)  *s  invertible 

»v  a»  ^ 

over  T(e),  A(e)  are  B(e)  are  over  T(t).  Thus,  ^(e)  is  over  T(e). 

(«-)  Trivial. 

The  standard  form  will  prove  to  be  very  useful  to  us,  especially  for 
finding  feedback  to  place  eigenvalues  (Section  III).  In  the  Appendix  we  develop 
an  algorithm  to  get  to  a  standard  form  without  first  constructing  the 
reachability  matrix  and  then  explicitly  determining  its  Smith  decomposition  in 
order  to  obtain  the  transformation  matrix  P(e).  The  algorithm  works  directly  on 
the  pair  (A(e).B(e)),  and  is  a  natural  extension  of  the  recommended  procedure 
[3]  for  testing  reachability  of  a  constant  pair  (A,B). 

1 1. 4  CONTINUOUS  TIME 


A  natural  counterpart  to  Definition  2.2  for  continuous  time  is  as  follows: 
Def inition  2.9:  x  €  T^e)  is  e^-reachable  if  3  t€R+  and  u(t)  €  l/e^Tm(e) 

V  t€[0,T]  such  that  x(t)  =  x.  with  x(0)  =  0. 

Let  3tJ  be  the  set  of  all  e^-reachable  states,  then  St^  C  2C*  C  3C^  C  . . .  and  3C^  is 
an  T(e) -submodule  of  T^e).  We  term  3C^  the  e^-reachable  submodule. 

These  submodules  have  properties  analogous  to  those  of  discrete  time  as  the 
following  proposition  and  corollary  show  (the  proofs  are  given  in  detail  in 
[18]): 

Proposition  2. 10:  Given  a  continuous  time  system  descibed  by  the  pair 

n 

(A(e).B(e)).  then  2°=<A(e) |S  XTTn(e)  where  <A(e) 1«  >syAi-1(e)S  and  «  is  the 

fc  c  L  c  c 

l 

image  of  B(e)  over  T(e). 
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Corollary  2.11-  9?  =  P(e)D(e')Tn(e)  where  ^(e)  =  P(e)D(e)Q(e)  is  a  Smith 


decomposition  for  the  reachability  matrix.  •• 

Using  the  iterative  relation  I^+*=^a,VlfcTn(e) } ,  (Proposition  2.3),  we  can 
recover  all  the  other  reachability  submodules  from  the  Smith  decomposition  of 
the  reachability  matrix  and  Corollary  2.11.  Therefore,  all  our  results  for 
discrete  time  also  hold  for  continuous  time. 

One  important  difference  exists,  however.  By  an  e-dependent  change  of  time 
scale  in  continuous  time,  we  can  satisfy  Statement  3  of  Proposition  2.6,  so 
there  is  no  loss  of  generality  in  assuming  that  a  continuous  time  system  (1.1) 
is  proper.  In  discerete  time,  by  contrast,  an  assumption  that  (1.2)  is  proper 
is  restrictive. 
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III.  SHIFTING  EIGENVALUES  BY  0(1)  USING  FULL  STATE  FEEDBACK 


In  this  section,  we  restrict  our  attention  to  reachable  systems  over  T(e). 
These  systems  are  proper  and  all  eigenvalues  of  A(e)  are  continuous  at  e=0.  We 
address  the  problem  of  arbitrarily  shifting  the  limiting  values  of  these 
eigenvalues  as  e-O,  using  full  state  feedback.  In  other  words,  we  wish  to  find 
F(e)  over  L(e)  such  that  Ap(e)  =  A(fe)+B(t)F(e)  has  the  desired  eigenvalues  as 
e-O. 


Example  3.1?  The  eigenvalues  of  A(e)  in  Example  2.1  are  at  A1=l+0(e)  and 
X2=2+0(e).  A  state  feedback  of  [2  4]  shifts  these  eigenvalues  to  3+0(&)  and 
2+0(fe).  It  is  not  hard  to  see  that  there  is  no  0(1)  state  feedback  that  can 
arbitrarily  place  X2  as  e-O.  However,  a  state  feedback  gain  of  [5  -1/e]  shifts 
the  eigenvalues  to  3+0(e)  and  4+0(e).  Here  both  eigenvalues  are  moved  as  e-O, 
but  an  0(l/e)  feedback  gain  has  to  be  used.  Note  that  the  closed  loop  system 

V,  -  [e!  *il/e]  •  »W  ■  £] 

is  not  over  T(e)  but  it  is  e-reachable  with  the  same  indices,  Uq=1  and  n^l,  as 
the  original  system,  and  is  in  proper  standard  form. 

We  shall  now  show  that,  for  systems  over  T(e),  the  order  of  feedback  gain 

necessary  and  sufficient  to  place  the  limiting  values  of  all  eigenvalues  as  e-O 

is  directly  given  by  the  order  of  reachability  of  the  system.  Let  us  start  by 

looking  at  e^-reachable  systems.  In  all  that  follows,  A  denotes  a 

self-conjugate  set  of  n  eigenvalues,  A(A)  denotes  the  spectrum  of  A,  and  Z 

denotes  the  set  of  all  integers.  Define 

a  =  min  (r|  VA.  3F(e)  =  0(l/er).  s.t.  X(A(e)+B(e)F(e)) |&=0=A}  (3.1) 

r€Z 

Hence  a  is  the  smallest  order  of  feedback  gain  that  will  produce  arbitrary 
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placement  of  the  limiting  eigenvalues  as  e-O. 


Lemma  3.2:  The  pair  (A(e),B(e)).  over  T(e),  is  e^-reachable  iff  ct=0. 

Proof :  (->)  If  the  pair  (A(£),B(e))  is  e^-reachable,  then,  ^(e)  I£_q  l13-5  full  row 

rank.  Thus,  the  pair  (A(0),B(0))  is  reachable,  and  VA,  3F:Rn  -»  lRn  s.t. 

A(A(e)+B(fc)F) |£_q  =  X(A(0)+B(0)F)  =  A.  Hence  a£0.  Now  assume  a<0.  Then, 

lim  F(e)  =  0  for  those  F(e)  of  0(l/ea)  that  produce  arbitrary  placement  of  the 
e  10 

limiting  eigenvalues  as  e-O  according  to  (3.1).  But  then  lim  (A(e)+B(fc)F(£) )  = 

eiO 

A(0),  so  no  limiting  eigenvalue  as  e-O  is  moved,  which  is  a  contradiction.  We 
conclude  that  a=0. 

(«-)  Conversely,  assume  that  a=0,  then  VA,  3F=F(e) |£_q  s. t.  X(A(0)+B(0)F)=A. 
Thus,  the  pair  (A(0),B(0))  is  reachable,  and  ^(e)  I£_q  ^ias  row  rank*  so  the 

pair  (A(e).B(e))  is  e^-reachable. 


Proposition  3.3:  The  pair  (A(e).B(e)),  over  T(e),  is  e-reachable  iff  a  =  k. 


Proof :  (-►)  If  the  pair  (A(e),B(e))  is  e-reachable,  then  the  pair  A(e)  = 

D  ^eJP  *(e)A(e)P(e.)D(e) .  B(e)  =  D  ^eJP  *(£)  is  e^-reachable  and  is  over  T(e) 
(Proposition  2.6).  Thus,  by  Lemma  3.2,  VA,  3  an  0(1)  F(e)  s.t. 

X(A(e)+B(e)F(e)) |fc=Q  =  A.  Let  F(e)  =  F(e)D-1(e)P-1(e) .  then  F(e)  is  0(l/ek). 

>V  /VI 

Since  (A£(e) ,B(e))  is  proper,  the  coefficients  of  ct( A£(e))  are  over  T(e).  Thus, 

lim  X(A(e)+B(e)F(e))  =  lim  X(A(e)+B(e)F(e))  (3.2) 

eiO  eio 

and  a<k.  To  see  that  the  equality  must  hold,  note  first  that 


A(e)  = 


A0,0^  fcA0. 1^  •  •  •  *A0,k(e) 
Al,0^  Al,l^6^  •  •  •  ©  Al,k^e^ 


Kc.O^  Vl^ 


(3.3) 


■ ' 

n-n^_j  columns 

where  the  Aj  j(fc)  are  over  T(e).  Now,  if  a<k,  then  the  last  n-n^_j  columns  of 
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F (0)  =  lim  F(e)P{fe)D(e)  =  0  for  those  F(e)  of  0(l/t  )  that  produce  arbitrary 
eiO 


eigenvalue  placement  according  to  (3.1).  But  then 

1 im(A(fc)+B(fc)F(e) )  =  '*  ° 

eiO 


(3.4) 


where  *  denotes  some  constant  entries,  and  the  limiting  eigenvalues 
corresponding  to  ^(e)  are  not  moved,  which  is  a  contradiction.  We  conclude 
that  a=k. 

(<-)  Clearly,  the  pair  (A(e),B(fc))  is  e^-reachable  for  some  j.  By  the  first  part 


of  this  proof,  a=j.  Hence  j=k  and  the  pair  is  e  -reachable. 


Note  that  if  some  pair  (A(e).B(e))  over  T(e)  is  e^-reachable  then  the 
closed  loop  pair  (Ap(e) ,B(e) ) .  where  Ap(e)  =  A(e)+B(e)F(e) ,  is  e^-reachable  for 
all  F(e)  of  0(1).  Thus  we  have  the  following  result: 

Corollary  3.4:  Given  a  pair  (A(e).B(e))  over  T(e).  the  e^-reachability  indices 
n.,  as  defined  in  Section  II. 3,  are  invariant  under  any  feedback  of  the  form 
F(e.)  =  F(e)D  *(e.)P  *  (e)  where  F(e)  is  0(1).  Also,  the  closed  loop  pair  is 
proper. 


The  -reachable  submodules  of  the  standard  form  are  uniquely  determined  by 
the  indices,  and  the  e^-reachable  submodules  of  the  original  system  are  uniquely 
determined  by  the  e^-reachable  submodules  of  the  standard  form,  via  P(e).  Thus: 
Corollary  3.5:  Given  a  pair  (A(e),B(e))  over  T(e).  the  e^-reachability 
submodules  are  invariant  under  any  feedback  of  the  form  F(e)  =  F(e)D  (e)P  (e). 
where  F(e)  is  0(1). 


For  the  more  general  class  of  proper  systems  over  L(e),  the  orders  of 
feedback  gains  do  not  necessarily  match  the  orders  of  reachability.  Let  us 
consider  the  following  example: 
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Example  3.6:  The  pair 


0  0  0' 

'l  o' 

A(e)  = 

0  0  1/e 

0  2e  0 

B(e)  = 

0  1 
0  0 

corresponds  to  an  e-reachable  system  in  proper  standard  form.  Let 


F(e)  = 

where  the  f^ 


f3  f4  T 

are  all  scalar  constants. 


then 


detfXI-Apft))  =  X3-(f1+f4)X2+(f1f4-f2f3-2)X+2fr  Clearly.  ^OR  can  be  chosen 
appropriately  to  match  any  third  degree  polynomial  with  real  coefficients. 
Therefore  all  eigenvalues  of  A(e)  can  be  arbitrarily  moved  as  e-O  using  only 
0(1)  feedback  gains.  What  happens  in  this  example  is  that  an  0(1)  gain  for  the 
third  state  component  produces  an  0(l/e)  input  for  the  second  component. 
Therefore,  even  with  0(1)  gains,  the  input  values  themselves  will  be  0(l/e),  as 
would  be  expected  when  producing  shifts  in  the  limiting  eigenvalues  for  this 
e-reachable  system. 


The  overall  effect  of  0(1)  feedback  on  the  eigenvalues,  even  for  systems 
over  T(e).  is  a  more  subtle  issue  than  the  order  of  feedback  necessary  to  shift 
the  limiting  eigenvalues.  Consider  the  following  example: 

Example  3.7:  Let 


A<6> -[“£]•  B(t)  =  [l 


The  reachability  order  indices  are  Hq=1  and  n^=2.  The  eigenvalues  of  A(e)  are 
at  ±Ve.  Feedback  of  [-1  -1]  moves  the  eigenvalues  to  -1  and  -e.  Thus,  the 
effect  of  feedback  is  larger  than  0(e).  namely  0(v£) .  (It  is  worth  noting  that 
the  original  system  did  not  have  well-behaved  time  scale  structure  in  the  sense 
of  [1,2],  and  that  the  feedback  produces  well-behaved  time  scale  structure.) 


We  leave  these  problems  for  further  research.  Section  V  suggests  some 
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potential  extensions. 


An  extension  of  Algorithm  A. 3  can  be  used  to  compute  the  feedback  matrix 
necessary  to  shift  eigenvalues  by  some  desired  amount.  Application  of  Algorithm 
A. 3  produces  a  pair  (A^e)  .  where  A^(e)  =  S  1(e)A(e)S(e) .  BjJe)  = 

S  *(e)B(e).  where  (A^O)  .B^O))  is  reachable  and  S(e)  is  the  product  of  all  the 
similarity  transformations  used  to  achieve  the  final  pair.  From  the  pair 

.B^fO)).  we  can  compute  a  feedback  matrix  F  such  that  the  eigenvalues  of 
Akp(0)  =  ^(0)  +  are  as  desired.  We  have  that  MAj^e))  l£_0=^(AkF(0) ) 

and  that  (Aj^pfe)  ,B(e))  is  proper.  Let  F(e)  =  FS  *(e)  and  Ap(e)  =  A(e)  + 
B(e)F(e).  Since  S(e)  is  invertible  for  e€(0,a)  for  some  a€1R,  (Ap(e).B(e))  is 
also  proper.  Therefore,  as  in  the  proof  of  Proposition  3.3,  the  eigenvalues  of 
Ap(e)  are  as  desired. 

This  algorithm  was  applied  in  [18]  to  a  fifth  order,  weakly  reachable 
system  over  IR  with  one  input.  The  system  was  first  parametrized  by  replacing 
certain  small  entries  by  (constant  multiples  of)  powers  of  e.  The  feedback  gain 
to  place  the  limiting  eigenvalues  calculated  for  the  parametrized  system  by  the 
above  approach  was  evaluated  at  the  specific  value  of  e  corresponding  to  the 
original  system.  This  approach  produced  far  better  numerical  results  than 
calculating  the  feedback  directly  for  the  given  system.  Similar  concerns  have 
been  expressed  by  authors  interested  in  numerical  issues  of  multivariable  pole 
placement  for  linear  time  invariant  systems  (as  explained  in  Section  1.1).  Our 
approach  would  attempt  to  address  those  Issues  by  scaling  the  pair  (A,B) 
appropriately.  Unfortunately,  (A.B)  has  to  be  parametrized  by  e  first  if  e  does 
not  represent  some  (small)  physical  parameter.  Further  study  of  this  problem  is 
left  for  future  research,  though  some  heuristic  suggestions  for  parametrizations 
are  made  in  Section  V. 
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IV.  ALMOST  INVARIANT  SUBSPACES 


IV. 1  (A(e) ,B(e) )- INVARIANCE  AND  ALMOST  ( A. B) -INVARIANCE 


In  this  section,  we  use  our  framework  to  provide  some  new  insights  on  the 
notions  of  almost  (A.B)-invariance  and  almost  (A.B)-controllability,  introduced 
into  the  geometric  approach  to  linear  systems.  [24],  by  J.  C.  Willems  [19]. 
These  concepts  have  applications  to  disturbance  decoupling,  robustness,  noisy 
gain  stabilization  and  cheap  control. 


To  provide  orientation  and  give  the  flavor  of  our  approach,  we  consider  the 
following  example: 

Example  4. 1 :  Let 


It  is  easy  to  see  from  the  results  in  [19]  that  H  =Im[l  0]'  is  an  almost 
(A.B)-invariant  subspace.  Consider  the  L(e) -subspace.  generated  by  [1  e]’. 
Since 


o  oil’ll  fol  , 

i  oj  UJ  =  LiJ  =  W(1/e) 


(-i/e). 


this  subspace  is  an  (A.B)-invariant  L(e)-subspace,  [24].  As  e  -*  0. 

-*■  Im[l  0]’  (over  1R) .  which  is  the  almost  (A.B)-invariant  subspace  identified 
above.  So  we  have  found  an  ( A, B) -invariant  L(&) -subspace  K  that  converges 
asymptotically  to  an  almost  (A.B)-invariant  subspace.  Using  the  relation 
(-1/e)  =  -F(e)[l  e] '  with  F(e)  =  [1/e  0],  1  is  Ap(e)  invariant,  where 
Ajr(e)  =  A  +  BF(e)  =  [^fc  °] . 

Furthermore,  f  is  a  coasting  subspace,  [19],  i.e.  it  is  (A.B)-invariant  but  has 
no  (A.B)-controllable  part,  whereas  1  is  a  sliding  subspace.  [19],  i.e.  it  is 

£L 

almost  (A.B)-invariant  but  it  has  no  (A.B)-invariant  part. 
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Note  that  an  eigenvalue  of  Ap(e)  -*  +®  as  e-O.  On  the  other  hand,  consider 

A  -Aw 

the  ( A, B) -invariant  L(e)-subspace  f  generated  by  [1  -e]’.  As  e-O,  7fc-n7a  also. 
By  going  through  the  above  procedure,  we  get  F(e)  =  [-1/e  0]  and 

-  H/e  0 

M  '  "  [  1  OJ* 

Now  the  eigenvalue  of  Ap,(e)  that  blows  up  approaches  -®  as  e-O. 

We  proceed  with  proving  some  results  related  to  the  above  observations: 

Def  ini  tion  4.2:  A  subspace  H  C  Ln(e)  is  fAfe)  .BfeD-invariant  if  3  F(e):  Ln(e) 

-»  Lm(e)  s.t.  Ap(e)tfe  C  7fe,  where  Ap(e)  =  A(e)  +  B(e)F(e).  We  denote  the  family 
of  (A(e) ,B(e) )-invariant  L(e) -subspaces  by  V^. 

A  straightforward  consequence  of  this  definition  is  the  following  well 
known  result  [24]: 

Proposition  4.3:  f  €  iff  A(e)7&  C  H&  +  38,  where  &  =  B(e)Lm(e). 

Let  7  C  Ln(e)  and  V(e)=[v1(e)|  ...  |v  (e)]  be  a  matrix  such  that  its 
columns  form  a  basis  over  L(e)  for  7  *  Let  V(e)=Pv(e)Dy(e)Qy(e)  be  a  Smith 
decomposition  of  V(e)  such  that  Py(fc)  is  nxp.  Dy(e)  and  Qy(e)  are  pxp.  Then  the 
columns,  p.(e),  of  Pv(e)  form  a  basis  over  L(e)  for  7  such  that  p. (e)  €  T^e) 
and  the  columns  of  Py(0)  is  a  basis  over  R.  We  use  this  for  the  existence  of 
the  desired  basis  in  the  following  definition: 

Definition  4.4:  Let  7£  C  Ln(e)  and  (v^e),  ....  v^(e)}  be  a  basis  over  L(e)  for 

7&  such  that  v^(e)  €  T^fc)  and  the  set  of  vectors  (v^(0) . v^(0)}  forms  a 

basis  over  R  for  some  7  C  Rn.  Then  we  say  that  7  converges  asymptotically  to 

CL  c 

7  or  7  - *f  (this  is  convergence  in  the  Grassmanian  sense). 

a  fce-0  a 

One  can  always  construct  a  matrix  W(e)  over  T(e),  such  that  W(0)  =  I  and 
v^e)  =  W(e)v^(0).  Thus  an  alternate  representation  of  7&  would  be  W(e)7a>  We 
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use  these  notions  to  connect  our  results  to  their  counterparts  in  [19]  and  [24]. 

The  following  result  enables  us  to  establish  a  connection  between  our 
framework  and  the  notion  of  almost  (A.B)-invariance.  It  provides  a  method  to 
compute  approximations  for  the  distributional  inputs  required  to  steer  the 
trajectories  of  an  almost  (A.B)-invariant  subspace  exactly  through  that 
subspace.  Using  these  high  gain  feedback  approximations  one  can  steer 
trajectories  arbitrarily  close  to  an  almost  (A.B)-invariant  subspace. 


Denote  the  family  of  almost  (A.B)-invariant  subspaces  by  V  .  We  then  have 

GL 

the  following  result: 

Proposition  4.5:  For  a  pair  (A,B),  if  H  €V  then  3  H  €V  such  that  f  - *  If  .  •• 

a  -a  e  -e  e  fc-o  a 

The  proof  is  very  similar  in  principle  to  that  of  Willems  [19]  and  it  is 
given  in  detail  in  [18].  However,  note  that  the  converse  of  the  above 
proposition  does  not  hold,  though  [19]  claims  that  it  does.  To  illustrate  this, 
consider  the  following  example: 


Example  4.6:  Let 


A  = 


°3°3 
X3  °3 


and  B  = 


CL 


Consider  H  =  {Vj(e) , v2(fc)  .v2(e)}  where  Vj(e)  =  [1  0  0  0  e  0]’, 

v2(e)  =[000100]’.  v2(fe)  =[010001]’  and  {•}  denotes  span  over  L(e). 

H  ^  V  and  If  - *  %  where  if  =  {v,  (0)  ,vo(0) ,v_(0)}  and  {•}  denotes  span  over  1R. 

fc-O  1/3 

But  S£  is  not  an  almost  (A.B)-invariant  sub  space  (this  can  easily  be  tested  using 
ISA  and  ACSA  [19]). 


Willems  [19]  poses  the  problem  of  finding  an  input  that  steers  the 
trajectories  of  a  system  arbitrarily  close  to  an  almost  (A.B)-invariant 
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subspace.  Our  approach  shows  how  this  can  be  done.  We  show  below  how  to 

construct  an  (A.B)-invariant  L(e)-subspace  that  converges  asymptotically  to  the 

almost  (A.B)-invariant  subspace.  The  desired  input  then  follows  on  calculating 

the  feedback  that  makes  the  ( A, B) -invariant  L(e)-subspace  Ap(e)-invariant. 

Recall  from  [19]  that  any  almost  (A.B)-invariant  subspace  H  can  be 

21 

represented  as  1!  where  H  is  (A.B)-invariant  and  91  is  almost 

&  8.  2L 

(A.B)-controllable.  Furthermore,  any  almost  (A.B)-controllability  subspace  2S 

3. 

can  be  represented  as  Sa=SSQffi9ls  where  91q  is  the  supremal  (A, B)-control lability 
subspace  in  91  and  S &  is  a  sliding  subspace.  By  a  construction  in  the  proof  of 

2L  S 

Proposition  4.5  in  [18],  illustrated  in  the  example  below,  we  can  find  1/  €  V 

c  -  c. 

where  H  =Q(e)St  ,  Q(e)  over  T(e)  and  Q(0)=I,  where  H  is  a  coasting  L(e)-subspace 
OS  c 

whose  associated  eigenvalues  approach  -co  as  e-O.  The  feedback  F(e)  that  makes 
Tc  an  Ap(e)-invariant  L(e)-subspace  can  be  calculated  and  provides  the  desired 
input.  Those  eigenvalues  of  Ap(e),  that  correspond  to  9&s  approach  -»  as  e-O. 
This  increases  the  magnitude  of  the  feedback  gains,  and  the  generated  inputs  and 
their  derivatives  approach  impulses  in  the  limit.  The  eigenvalues  corresponding 
to  can  be  assigned  by  the  usual  pole  placement  methods. 

As  an  illustration  of  the  procedure,  consider  the  following  example,  which 
contains  the  essential  features  of  the  general  case: 

Example  4.7:  Let 


0  0  o' 

V 

l' 

o' 

A  = 

10  0 
0  1  0 

.  B  = 

0 

0 

.  fa  =  {Vj.Vg},  where  Vj  = 

0 

0 

and  = 

1 

0 

f  is  an  almost  (A.B)-invariant  subspace,  and  in  fact  it  is  a  sliding  subspace. 
Consider  =  (VjCe)  .Vgfe)}.  where  v^e)  =  [1  -e  e2]*  and  =[0  1  -2e]  ’ . 

Note  that  1  is  a  coasting  L(e)-subspace,  i.e.  it  is  (A.B)-invariant  but  not 
(A.B)-controllable.  Furthermore,  v.  (0)  =  v. .  vo(0)  =  v„  and  H  - .  Also, 

1  Z  ee-0  a 


v.(e)=P(e)v1 
P(e)  = 


,  for  i=l,2, 

'  1  0  O' 

-e  1  0 

2e  -e2  1 


where 
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gets  its  lower  triangular  entries  from  a  Pascal  triangle  construction  with 

alternating  signs  (see  [18]).  Solving  the  equations 

ACOCvjU)  |v2(e)]  =  [VjU)  |v2(e)]gv(e)+Bgu(e), 

gu(e)  =  -F(6)[Vl(e)|v2(c)] 

yields  -F(e)=[2/e  1/e2  0]'  and 

-2/e  -1/e2  O' 

A  (e)  «  A  +  BF(e)  =100 

0  1  0. 

with  being  Ap(e)-invariant.  Note  that  the  desired  input  u(t)  =  F(e)x(t).  On 
the  other  hand,  the  eigenvalues  of  Ap(e)  that  correspond  to  H  are  both  at  -1/e. 
They  are  stable  and  approach  -«  as  e-O. 

IV.  2  (A(e)  ,B(e)) -CONTROLLABILITY  AND  ALMOST  ( A. B) -INVARIANCE 

We  now  proceed  with  the  notion  of  (A(e) ,B(e))-controllability 
L(e) -subspaces,  adopting  Wonham’s  definition  [24]  of  (A.B)-controllabil  ity 
subspaces.  The  notation  <A(e)  |3&>  will  be  used  to  denote  £6  +  A(e)28  +  AT(e)&  .  .  . 

Def inition  4.8:  fk  C  Ln(e)  is  an  (A(e) ,B(e) )-contro liability  subspace  if  there 
exist  maps  F(e).*Ln(e)  -*  Lm(e)  and  G(e):Lm(e)  -*  Lm(e)  such  that 
=  <A(e)+B(e)F(e) | Im(B(e)G(e))>.  We  denote  the  family  of 
(A(e) ,B(e) )-control lability  L(e) -subspaces  by  R^. 

To  put  the  above  definition  into  a  more  usable  form,  consider  the  following 
proposition,  which  simply  restates  results  of  Wonham  [24]  in  the  present 
framework: 

Proposition  4.9:  (a)  2S  €  R  iff  there  exists  a  map  F(e)  :Ln(e)-»Lm(e)  such  that 
=  <A(£)+B(e)F(e) where  S  represents  the  range  of  B(e)  over  L(e). 

(b)  S S  =  <A_(e)  |9ST0i  >  for  every  map  F(e)  €  F(9t  ),  where  F(9l  )  represents  the 

C  f  6  £  £> 
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family  of  feedback  matrices  F(e)  such  that  &&  is  Ap(e)-invariant . 

Let  3t  €  R  and  #  - »  #  .  Then,  it  turns  out  that  &  is  almost 

e  — e  £  „  n  n 

e-O 

(A.B)-invariant .  Finding  inputs  for  steering  trajectories  arbitrarily  close  to 
is  done  by  calculating  an  F(fe)  such  that  is  Ap(e)-invariant  and  the 
eigenvalues  corresponding  to  are  continuous  at  e=0  and  asymptotically  stable 
The  following  lemma  and  proposition  show  this: 


Lemma  4.10:  Given  a  pair  (A.B),  let  &  €  and  - *5^,  then  V  0(1)  xn  s.t. 


£e-0  n 


,4 


d(xQ,3{n)  is  0(e)  and  Vt>0,  3  an  input  function  u(t)  s.t.  d(xQ(t,e) ,#n)  is  0(e) 
for  0<t£r,  where  x^t.e)  is  the  trajectory  defined  by  u(t)  and  the  initial 
condition  Xq. 

Proof :  Here  we  first  need  to  find  a  trajectory  in  which  is  0(1)  for  0<t<r. 
Find  F(e)  s.t.  is  Ap(e)-invariant  and  the  eigenvalues  of  Ap(e)  corresponding 
to  are  all  continuous  at  e=0  and  asymptotically  stable.  Then  V  0(1)  x^  € 
x^t.e)  €  Vt>0  where  x^t.e)  is  the  trajectory  defined  by  the  initial 
condition  x^  and  the  input  specified  by  F(e)x(t).  Since  the  eigenvalues  of 
Ap(fe)  corresponding  to  are  all  continuous  at  e=0  and  stable,  Xj(t.e)  is  0(1) 


Therefore,  d(x,(t,e),&  )  is  0(e),  since  &  - &  .  Consider  x«,(t.e).  the 

1  n  ee-0  n  * 

trajectory  defined  by  the  initial  condition  x^sXq-Xj,  with  Xj  €  chosen  such 
that  X2  is  0(e).  Since  the  eigenvalues  of  Ap(e)  are  continuous  at  e=0,  Vt>0 
is  0(e)  for  0<t£r.  Thus,  d(xQ(t,e) ,Sn)  is  0(e)  for  0<t£*r. 


Proposition  4.11:  Given  a  pair  (A.B),  let  €  R.  and  91. - then  €  V_. 

XX  xx 

Proof :  Pick  some  r> 0  and  apply  Lemma  4.10.  Thus,  3u(t)  s.t.  d(x(t,e),#n)  is 


d(x,L)  =  inf  x ,  €L 


llx-x  ’  II 
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0(e)  for  OCt^T.  Then  3  eQ>  0  s.t.  d(x(t,e),ftn)  <  5  for  0<t^T  and  Ve££Q.  Use 
x(T,e)  as  the  initial  condition  to  reapply  Lemma  4.10  for  the  interval 
t  <  t  £  2t.  Find  e^O  s.t.  and  d(x(t,6j),ftn)  <  6  for  r  <  t  £  2r. 

Repeated  use  of  Lemma  4.10  achieves  the  desired  result. 

To  illustrate  these,  consider  the  following  example: 

Example  4. 12:  Let 


A  = 

0  0  O' 
0  0  0 

.  B  = 

'l  O' 
0  1 

and  ft  =  Im 

V 

e 

+  Im 

o  o 

0  1  0 

0  0 

e 

0. 

UJ 

Note  that  ft^  =  Im[l  0  0]‘+Im[0  0  1]'  and  it  is  an  almost  (A.B)-invariant 
subspace.  Let  F(e)  =  [-3  0  -2/e],  then  ft£  is  Ap(e)-invariant  and  the 

eigenvalues  corresponding  to  ftfc  are  at  -2,  -4.  asymptotically  stable  and  0(1). 

Pick  the  initial  state  Xq  of  Lemma  4.10  as  Xq  =  [1  0  0] ’ .  Let  x^  =  [1  e  0]'  € 

ft  .  Then,  x.ft.e)  =  [-e  *+2e  2t  -ee  Z+2ee  2t  -ee  t-ee  2t]’  €  ft  ,  and 

d(x^(t,e) ,ftn)  is  clearly  0(e)  for  any  finite  t.  On  the  other  hand,  =  [0  -e 
0]’  and  x^t.e)  =  [2ee"2t  2e2e_2t  -e2e“2t]\  Thus,  d(x0(t).*n)  is  0(e).  So.  in 
the  spirit  of  Proposition  4.11,  this  may  be  bounded  by  any  6  for  any  given  t  by 
picking  an  appropriate  fe=*0-  Then,  using  x(r,e)  as  the  new  initial  state  and 
repeated  use  of  this  procedure  achieves  the  desired  result. 

* 

In  this  section,  we  examined  the  notions  of  almost  (A.B)-invariant  and 
almost  (A.B)-controllability  subspaces  in  the  framework  that  we  have  developed 
in  this  paper  and  [18].  We  outlined  a  method  for  calculating  inputs  that  steer 
trajectories  arbitrarily  close  to  almost  (A.B)-invariant  subspaces  or 
equivalently  force  the  eigenvalues  corresponding  to  sliding  parts  of  almost 
(A.B)-controllability  subspaces  to  approach  We  also  analyzed  the  properties 

of  limits  of  elements  in  V  and  R  as  e-O  from  a  trajectory  point  of  view. 
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V.  CONCLUSIONS 


In  this  paper,  we  have  developed  an  algebraic  approach  to  high  gain 
controls  for  linear  dynamic  systems  with  varying  orders  of  reachability.  Based 
on  this  approach,  we  addressed  the  issues  of  high  gain  inputs  for  reaching 
target  states,  high  gain  feedback  for  pole  placement  and  high  gain  inputs  for 
steering  trajectories  arbitrarily  close  to  almost  ( A. B)- invariant  subspaces  and 
almost  (A.B)-control lability  subspaces. 

The  results  presented  here  suggest  several  directions  for  further  research. 
It  is  of  interest  to  analyze  the  orders  of  feedback  gains  for  shifting  the 
limiting  eigenvalues  as  e-O  in  the  more  general  case  of  proper  systems,  rather 
than  just  systems  over  T(e).  Intuitively,  if  a  mode  is  e-reachable  but 
"1/e-observable" ,  in  that  it  has  a  1/e  coupling  to  other  states,  then  it  should 
be  possible  to  shift  its  eigenvalue  by  0(1)  using  0(1)  feedback  gain.  A  related 
problem  is  that  of  changing  the  dynamics  of  a  given  continuous  time  system  that 
has  multiple  time  scales  [1,2]  without  changing  its  time  scale  structure.  This 
would  involve  shifting  an  eigenvalue  A,  where  A/fc^  is  continuous  at  e=0,  by  some 
ae^ ,  a>0. 

A  key  problem  that  bears  attention  is  that  of  parametrizing  systems  over  R. 
Two  heuristic  methods  could  be  suggested  for  this.  One  is  to  recognize  small 
entries  in  the  matrix,  either  isolated  or  added  to  another  entry,  and  replace 
these  with  powers  of  e.  Another  method  for  parametrization  could  come  from 
numerical  reachability  tests  [3],  where  for  example  small  singular  values  at 
different  stages  of  a  test  may  be  replaced  by  (appropriate  powers  of)  e. 

It  will  be  important  to  develop  dual  results  for  systems  with  observations 
y[k]  =  C(e)x[k]  or  y(t)  =  C(e)x(t).  This  could  then  lead  to  research  on 
connections  to  optimal  control  [25,26],  realization  theory,  balanced 
realizations,  [15],  and  so  on. 
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Very  interesting  and  important  generalizations  may  be  expected  from  more 
explicit  connection  to  and  exploitation  of  the  rather  large  literature  on 
systems  over  rings,  as  represented  in  [6-9]  for  example.  In  particular, 
extensions  to  problems  involving  outputs  will  undoubtedly  emerge  from  this. 

Acknow 1 edgemen t s :  The  authors  are  very  grateful  to  Professor  Eduardo  Sontag  and 
the  reviewers  for  their  painstaking  comments  on  the  first  version  of  this  paper. 
We  have  tried  to  reflect  their  suggestions  in  this  revision. 
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APPENDIX 


Here  we  develop  an  algorithm  to  recover  a  standard  form  without  forming  the 
reachability  matrix  and  computing  its  Smith  decomposition.  The  proofs  and 
details  on  the  algorithm  are  presented  in  [18].  Our  algorithm  can  only  deal 
with  a  pair  (A(e),B(e)}  over  T(e).  so  this  restriction  is  assumed  here.  The 
structure  of  a  pair  (A(fe),B(fe))  in  standard  form  is  then  as  follows: 

l>P0 


A(e)  = 


A0.0^6^ 

eAl.oU) 


A0>i(e)  .  . 


A0.k<fe> 


Al,l^e^  ‘  *  '  Al,k^e^ 


•  • :  *k>> 


}Pi 


>Pi 


(A.  la) 


B(e)  = 


eB^e) 


>P0 

}Pl 

>Pk 


(A. lb) 


Proposition  A. 1  :  An  e  -reachable  pair  (A(fc).B(fc))  over  T(e)  is  in  proper 


standard  form  with  indices  pQ, 


Pk  iff  A(e)  and  B(e)  satisfy  the  following 


condition:  Let  F^e)  =  Di^(e)A(e)Di(e) ,  G^(e)  =  D^CeJBCe)  where  D^e)  = 


diag{I 


.  e1! 


■0 


V 


=  Im 


n. 


•  +pk 
,  for  Vi  €  [0. ..k]. 


}  then  the  reachable  subspace  of  (FjCO)  .G^O))  is 


Definition  A. 2:  Let 


At(e)  = 


Al.l(£> 


i.  *  ,  .  i-1. 

e  Ai A 


i.l 


(O 


A0, i^e^ 
Ai.i(e) 


>»0 

>Pl 

>P. 


(A. 2a) 
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Vo  = 


B0(e) 

eBj(0 

6^(6) 


>PC 

}Pi 


>P< 


(A. 2b) 


then  (Ai(e) ,§i(£))  is  the  e  -reachable  subsystem  of  (A(e).B(e))  wi th  Indices  n^. 


n. 


As  with  the  submodule  structure,  the  e*-reachable  subsystem  contains  all 
e^-reachable  subsystems  for  j  =  0,  ...  ,  i-1.  The  subsystems  are  layered  with 
weak  couplings  of  different  orders  of  6  between  each  component.  Also, 


“i  <+1  Q 

Ve)T  (O  ®  £  T  V)  D  (A. 3) 

H^i  «  +  1  n— Q 

and  the  sequence  {^(eJT  (e)  ®  e  T  (e)}  converges  to  “5/  in  k  steps.  In 
other  words,  the  e^-reachable  submodules  of  the  e^-reachable  subsystems 
approximate  the  e^-reachable  submodule  of  the  system  in  standard  form  upto 
accuracy.  We  use  this  in  Algorithm  A. 3  below. 

Computation  of  the  reachability  matrix  is  very  costly.  One  has  to 
calculate  A1(e)B(e)  for  all  the  terms  in  the  expansions  of  A(e.)  and  B(e).  Thus, 
it  is  desirable  to  work  directly  with  the  pair  (A(fc).B(e)).  The  following 
algorithm  takes  advantage  of  Proposition  A.l  to  recover  the  e^-reachability 
indices.  At  every  step,  the  reachable  subspace  of  a  pair,  evaluated  at  &=0,  is 
computed.  Then  the  pair  is  updated  by  an  appropriate  scaling  of  the  unreachable 
part  by  1/e.  The  algorithm  uses  the  higher  order  coefficients  of  the  asymptotic 
expansions  only  when  necessary.  Also,  it  is  possible  to  recover  the  actual 
Smith  decomposition  of  the  reachability  matrix  from  the  algorithm,  if  the 
transformations  used  in  the  algorithm  are  restricted  to  be  permutation  matrices 
and  lower  triangular  matrices,  though  this  restriction  compromises  numerical 
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stability  (see  [18]). 


Algorithm  A. 3-* 

Initialize:  Ag(e)  =  A(e) ,  Bq(£)  =  B(e),  i  =  0 
Step  i: 


1.  Find  such  that 

U^1A1(0)Ui  = 


A1  A2 

L°  A3J 


}n 


i.  u;1Bi(o)  = 


B, 


0 


K 


with  (A^.Bj)  reachable.  This  determines  n^. 

2.  If  =  n  then  go  to  End,  else  continue. 

3.  Let  Ai+1(e)  =  D^eJU^A^e^D^e) .  B.+1  *  D^feJU^B^e) 


where  D^e)  =  diag{In^.  el  }, 

(It  is  not  necessary  to  carry  out  the  computation  for  all  the 

coefficients  of  A^(e)  and  B.(e);  see  Note  1  in  [18].) 

4.  Increment  i,  go  to  Step  i. 

k 

End:  k  =  i,  the  system  is  e  -reachable  with  indices  nn  ....  n,  . 
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